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Abstract: Road sign recognition is one of the core 
technologies in Intelligent Transport Systems. In the 
current study, a robust and real-time method is 
presented to identify and detect the roads speed signs 
in road image in different situations. In our proposed 
method, first, the connected components are created in 
the main image using the edge detection and 
mathematical morphology and the location of the road 
signs extracted by the geometric and color data; then 
the letters are segmented and recognized by Multiclass 
Support Vector Machine (SVMs) classifiers. Regarding 
that the geometric and color features ate properly used 
in detection the location of the road signs, so it is not 
sensitive to the distance and noise and has higher 
speed and efficiency. In the result part, the proposed 
approach is applied on Iranian road speed sign 
database and the detection and recognition accuracy 
rate achieved 98.66% and 100% respectively. 

Keywords: Road sign detection and recognition, edge 
detection, mathematical morphology, SVM classifier. 

I. INTRODUCTION 

Road sign recognition is one of the core 
technologies in Intelligent Transport Systems (ITS). 
This is due to the importance of the road signs and 
traffic signals in daily life. They define a visual 
language that can be interpreted by the drivers. They 
represent the current traffic situation on the road, show 
the danger and difficulties around the drivers, give 
warnings to them, and help them with their navigation 
by providing useful information that makes the driving 
safe and convenient [1]. 

The field of road sign recognition is not very old; 
the first paper appeared in Japan in 1984. The aim was 
to try various computer vision methods for the 
detection of objects in outdoor scenes. Since that time 
many research groups and companies are interested 
and conducted research in the field, and enormous 
amount of work has been done. Different techniques 



have been used, and big improvements have been 
achieved during the last decade. 

Road sign recognition systems usually have 
developed into two specific phases [2-9]. The first is 
normally related to the detection of traffic signs in a 
video sequence or image using image processing. The 
second one is related to recognition of these detected 
signs. The detection algorithms normally based on 
shape or color segmentation. The prevalent approach 
in detecting traffic signs based on color is very obvious 
one finds the areas of the image which contain the 
color of interest, using simple thresholding or more 
advanced image segmentation methods. The resulting 
areas are then either immediately designated as traffic 
signs, or passed on to subsequent stages as traffic sign 
location hypotheses (i.e. regions of interest). The main 
weakness of such an approach lies in the fact that color 
tends to be unreliable - depending on the time of day, 
weather conditions, shadows etc. the illumination of 
the scene can vary considerably. RGB color space is 
considered to be very sensitive to illumination, so 
many researchers choose to carry out the color-based 
segmentation in other color spaces, such as HSI or 
L*a*b. Some methods that implemented on this 
approach are [10-20]. 

Several approaches for shape-based detection of 
traffic signs are implemented. Probably the most 
common approach is using some form of Hough 
transform. Approaches based on corner detection 
followed by reasoning or approaches based on simple 
template matching are also popular. Sample of these 
approaches proposed in [21-23]. Also some 
approaches use the prior knowledge of the problem 
(the expected color and shape of a traffic sign) as 
machine learning way for traffic sign recognition like 
[24]. 

In this paper we proposed a method based on color 
and shape characteristic of traffic speed sign for 
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In section two the proposed methods is presented. In 
section three the practical result and implementation 
phase is described. Finally in section four, conclusion 
and future work is demonstrated. 

II. PROPOSED METHOD 

General diagram of the proposed method is shown 
in Figure 1 . In the proposed method, the input image is 
pre-processed at the first time and then traffic sign 
location is specified by edge detection and morphology 
operation and finally traffic sign location is extracted 
and their characters are recognized. 
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Figure 1: General Diagram of the proposed method 

A. Pre-processing & Component Extracting 

Pre-processing is carried out on the image to 
improve the quality of the image so that the main 
processing on the image becomes easier. This step 
involves image converting to grey scale, edge 
detection, noise removing by mathematical 
morphology and extracting connected component. 

1. Gray Scale Conversion 

The road sign location in this paper are based on 
gray image, so the main function of the pretreatment 
algorithm is to convert color images to gray scale 
images for the latter operation. A color bitmap is 



composed of R, G and B 3 components. If it is a 24-bit 
true color image, every point is made up of three bytes 
which respectively represent R, G and B. Therefore, 
the following is color information of image. Figure 
2(b) shows the entrance image in gray mode. 

2. Edge Detection 

Edge detection is a type of image segmentation 
techniques which determines the presence of an edge 
or line in an image and outlines them in an appropriate 
way [25]. The main purpose of edge detection is to 
simplify the image data in order to minimize the 
amount of data to be processed [26]. Generally, an 
edge is defined as the boundary pixels that connect two 
separate regions with changing image amplitude 
attributes such as different constant luminance and 
tristimulus values in an image [25], [27] and [28]. 
There are different approaches and algorithm to find 
out the edge in image processing that, in the meantime, 
canny operator due to high accuracy and low 
processing volume has a more favorable performance 
compared to other methods for our database. Figure 
2(c) shows the result of edge detection on entrance 
image. 

3. Mathematical Morphology 

Mathematical morphology is the branch of image 
processing that argues about shape and appearance of 
abject in images. The erosion and dilation operators 
are basically operators of mathematical morphology 
that are used in this part to improve the edge detection 
image. At this step, first erosion action is applied in the 
edge detection image. After erosion action on image, 
the dilation action is done. 

4. Extracting Connected Component 

For extracting connected component in this step, 
first, the holes are filled then the area with 8 connected 
neighbours is labeled as connected component. Figure 
2(d) shows the result. 




Figure 2: a: Original image b: image in grayscale mode 
c: edge detected image d: extracted connected component 
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B. Road Sign Extracting 

In this stage the road sign is extracted and its 
characters are distinguished. This stage involves road 
sign detection and probability noise removing for 
character extracting. 

1. Road Sign Detection 

In this part, the color and texture features used to 
identify the location of the road signs. Considering that 
the road speed signs are circular and marked with red 
areas in the edge of the circle (Figure 2(a)), so these 
features are used in the current study to identify the 
location of the road speed signs. Therefore, first the 
degree of the circularity of every connected region is 
calculated using Equation (1): 



Metric = 4n * Area j 



Perimeter 2 



(i) 



Where 71=3.1415, Area is an object area and 
perimeter is an object perimeter. The regions which 
circularity degree is between 0.9 < Metric > lare 
chosen as candidates and the red color is examined on 
that region due the red edge, that region is considered 
as the location of the road sign and is extracted from 
the main image. Figure 3 shows the result. 




Figure 3: a: corresponding metric of each object 

To detect the red edge, first the candidate location 
from the main image is brought in the colored place of 
HSV. then, its red pixels are detected by Equation (2). 
Figure 4(a) shows the extracted road sign. 



Pixel Color(x) = 

( Is Red, S > 0.45 A V > 

(Not Red, O.W 



0.5 A 0.8 < H < 0.94 

(2) 



2. Removing Noise and Extracting Numerals 

In this paper from last step, the area that is 
exploited as a road sign, first probable noising and red 
color pixel are resolved, then road sign image is 
complemented till its writing of plate inside is seen 
such white violence. Then this area is labeled and 



through the available regions, the regions that are 
bigger are stored as exploited characters in 60*30 
sizes. Figure 4(b) shows the extracted road sign after 
removing noise. 



a b 

Figure 4: a: Extracted road sign b: road sign after 
removing noise and red color 

C. Feature Extracting 

In our system we computed features based on 
transit and angel of contour pixels of the images as 
follows: First we found the bounding box (minimum 
rectangle containing the numeral) of each input image 
which is a two-tone image. Then for better result and 
independency of features to size, font and position 
(invariant to scale and translation), we converted each 
image (located in bounding box) to a normal size of 
60x30 pixels. We chose this normalized value based of 
various experiments and a statistical study. In Figure 
5(a), a normalized image with its bounding box is 
shown. We extracted the contour of the normalized 
image Figure 5(b). 




a b 



Figure 5: a: Bounding box of a normalized image (b): 
Digit '6' contour form. 

We scanned the image contour horizontally by 
keeping a window-map of size 10x10 on the image 
from the top left most point to down right most point 
(18 non overlapped blocks). For each block the transit 
and angel feature were computed. To extract features, 
we considered 18 (10*10) uniform blocks in each 
image and we computed three features in each block so 
we got 18x2=36 features for each image. 

1. Angel Features Extraction 

Angle features are very important features in order 
to achieve higher recognition accuracy and reducing 
misclassification. These features are extracted from 
image by the equation (3) that we mentioned earlier in 
[29]. 



1 V nt> b 
( a b) = " + / 9k ,b=l,2,3,.. 



(3) 
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In the top relation, a b is angel average for any 
block and Q\ angle of white pixel to block horizontal 
level. The steps that have been used to extract these 
features are given below [29]: 

Step 1. Divide the input image into n (n=18) number of 
block, each of size 10x10 pixels; 

Step 2. Calculate for each block of image, angel degree 
with use of equation (3) and set These 18 sub- 
features as an angel feature; 

Step 3. Corresponding to the blocks whose angel does 
not have a foreground pixel, the feature value is 
taken as zero. 

Using this algorithm, we will obtain 18 features 
corresponding to every block. 

2. Transit Feature 

In a binary image, whenever a pixel value changes 
from to 1 or 1 to it indicates the information about 
the edge. This information is very significant as it 
denotes the geometry of the character and helps in 
identifying the character [30]. In order to capture this 
information, we have used Run Length Count (RLC) 
technique. In the proposed method, for every block, we 
find the Run Length count in horizontal and vertical 
direction. A total of 18 features will be extracted for 
each characters and this will serve as feature vector. 
Following steps have been implemented for extracting 
these features [31]. 

Step 1. Divide the input image into n (n=18) number of 
block, each of size 10x10 pixels; 

Step 2. Calculate for each block of image, Run Length 
count in horizontal and vertical direction and 
set their ratio as feature; 

Step 3. Corresponding to the blocks whose does not 
have a foreground pixel, the feature value is 
taken as zero. 

Using this algorithm, we will obtain 18 features 
corresponding to every block. 

D. Classification 

Support vector machines (SVMs) [32] are very 
popular and powerful in pattern learning because of 
supporting high dimensional data and at the same time, 
providing good generalization properties. Moreover, 
SVMs have many usages in pattern recognition and 
data mining applications such as text categorization 
[33] and [34] phoneme recognition [35], face 
recognition [36] and etc. At the beginning, SVM was 
formulated for two-class (binary) classification 
problems. The extension of this method to multi-class 
problem is neither straightforward nor unique. DAG 
SVM [37] is one of the methods that have been 
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proposed to extend SVM classifier to support multi- 
class classification. 

1 . Binary support vector machine formulation 

X = {(Xi,yi)} n i = 1 be a set of n training samples, 
where Xj E R m is an m-dimensional sample in the 
input space, andyiE{— 1,1} is the class label of 
sample xi. SVM finds the optimal separating hyper 
plane (OSH) with the minimal classification errors. 
The linear separation hyper plane is in the form of 
Equation (4). 

f(x) = W T x + b (4) 

Where w and b are the weight vector and bias, 
respectively. The optimal hyper plane can be obtained 
by solving the optimization problem (7), where <^is 
slack variable for obtaining a soft margin while 
variable C controls the effect of the slack variables. 
Separation margin increases by decreasing the value of 
C. In a support vector machine, the optimal hyper 
plane is obtained by maximizing the generalization 
ability of the SVM. However if the training data are 
not linearly separable, the obtained classifier may not 
have high generalization ability, even though the hyper 
planes are determined optimally. To enhance linear 
severability, the original input space is mapped into a 
high-dimensional do product space called the feature 
space. Now using the nonlinear vector function 
<P(X) - (<Pi(XK that maps the m- 

dimensional input vector x into the 1-dimensional 
feature space, the OSH in the feature space is given by 
Equation (5): 

f(x) = W T cp(x) + b (5) 

The decision function for a test data is Equation (6): 

D(x) = Sign(W T cp{x) + b) (6) 

The optimal hyper plane can be found by solving 
the following quadratic optimization problem: 

Minimize \ \\W\\ 2 + CZ? =1 <^ 
Subject to yi(W T cp(x) + b) > 1 - & 

>0,£ = l,...,n (7) 

2. Multiclass support vector machine 

As described before, SVMs are intrinsically binary 
classifiers, but, the classification of faces involves 
more than two classes. In order to face this issue, a 
number of multiclass classification strategies can be 
adopted [38] and [39]. The most popular ones are the 
one-against-all (OAA) and the one-against-one (OAO) 
strategies. The one-against-one constructs (n(n- 
l))2decision functions for all the combinations of 
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class pairs. Experimental results indicate that the one- 
against-one is more suitable for practical use. We use 
OAO for extracted numeral classification. 



III. IMPLEMENTATION AND PRACTICAL 
RESULT 

Our suggestive method have been done on Intel 
Core i3-2330M CPU, 2.20 GHz with 2 GB RAM 
under Matlab environment. Figure 6 shows the face of 
worked systems. 
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Road and Traffic Speed Sign Detection and Recognition System for 
Intelligent Driving System 

Road and traffic sign recognition is one of the core technologies in Intelligent Transport 
Systems. In the current study, a robust and real-time method is presented to identify 

and detect the roads speed signs in road image in different situations. In our 
proposed method, first, the connected components are created in the main image 
using the edge detection and mathematical morphology and the location of the road 
signs extracted by the geometric and color data; then the letters are segmented and 
recognized by Multiclass Support Vector Machine (SVMs) classifiers. Regarding that 
the geometric and colorfeatures ate properly used in detection the location of the 
road signs, so it is not sensitive to the distance and noise and has higher speed 
and efficiency. In the result part, the proposed approach is applied on Iranian traffic 
speed sign database and the detection and recognition accuracy rate achieved 
93.66% and 100% respectively. 



Figure 6: road speed sign detection and recognition system 



In this study, for experimental analysis, we 
considered an Iranian road speed sign database for 
detection and recognition. The Iranian road speed sign 
database is an Iranian database that contains a set of 
375 colorful traffic images with 5 classes for each limit 
of speeds [40]. These images have different 
background, distance observes and angel of view, also 
some of them contain noises and categorized in 5 class 
with limit speed from 20 to 100 by English writing 
digits. The results are as presented in table 1 and 2. 



Table 1: Comparison of different algorithms on traffic 
sign detection 



Number 

of 
Images 


Iranian Road Speed Sign Data Set 


Method 


Technique 


Efficiency 


375 


[40] 


Normalized 
cross correlation 


93% 


Our Method 


Combination of 
Shape and Color 
feature 


98.66% 
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Table 2: Comparison of different algorithms on Road 
sign Recognition 



Number 

of 
Images 


Iranian Road Speed Sign Data Sset 


Method 


Technique 


Efficiency 


375 


[40] 


Normalized 

cross 
correlation 


93% 


Our Method 


SVM Classifier 


100% 



Our method compared with [40] has best result 
because it's independent on noise and distance. Figure 
7 shows the accuracy rate in different distance betwixt 
our method and [40]. Blue line shows our method 
accuracy and red line shows the [40] method accuracy 
in each distance. 

in 5 Meter 
Distance 



30 




Distance Distance 

Figure 7: Accuracy rate in different distances 

High detection rate shows the quality of proposed 
approach to use in every applications, which are 
needed a road speed sign detection and recognition 
stage. Low complexity in computation and time are 
some of other advantages of the proposed approach. 

IV. CONCLUSION AND FUTURE WORK 

In this paper we propose an approach based on 
shape and color characteristic for road speed sign 
detection and recognition in still images. In our 
mentioned method, first, the connected components 
are created in the main image using the edge detection 
and mathematical morphology and the location of the 
road signs extracted by the geometric and color data; 
then the letters are segmented and recognized by 
Multiclass Support Vector Machine (SVMs) 
classifiers. We tested our method on Iranian road 
speed sign database and the accuracy rate reached 
98.66 and 100% for detection and recognition stage 
respectively. Regarding that the geometric and color 
features ate properly used in detection the location of 



the road signs, so it is not sensitive to the distance and 
noise and has higher speed and efficiency. 

This work is implemented for still images, for 
future work we have planned to extend it for road sign 
detection and recognition in video stream. Also 
occasionally accuracy decreased when the background 
was so complex, for solving this problem in the future 
work we will express the method based on edge 
analysis stage for reducing complexity and solving this 
problem. 
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